<!DOCTYPE html>
<html>
<head>
  <meta charset="utf-8">
  
  <title>Linux IO performance monitor | Matrix207&#39;s Blog</title>
  <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1">
  <meta name="description" content="What your should know
Your system parameters:

storage device: HDD, SSD (which?), Raid (which?)
filesystem, block size, journal mode
file cache, dirty thresholds, amount of memory
IO scheduler, its tu">
<meta property="og:type" content="article">
<meta property="og:title" content="Linux IO performance monitor">
<meta property="og:url" content="http://yoursite.com/2014/07/30/linux-io-performance-monitor/index.html">
<meta property="og:site_name" content="Matrix207's Blog">
<meta property="og:description" content="What your should know
Your system parameters:

storage device: HDD, SSD (which?), Raid (which?)
filesystem, block size, journal mode
file cache, dirty thresholds, amount of memory
IO scheduler, its tu">
<meta property="og:updated_time" content="2016-07-17T14:33:54.000Z">
<meta name="twitter:card" content="summary">
<meta name="twitter:title" content="Linux IO performance monitor">
<meta name="twitter:description" content="What your should know
Your system parameters:

storage device: HDD, SSD (which?), Raid (which?)
filesystem, block size, journal mode
file cache, dirty thresholds, amount of memory
IO scheduler, its tu">
  
    <link rel="alternate" href="/atom.xml" title="Matrix207&#39;s Blog" type="application/atom+xml">
  
  
    <link rel="icon" href="/favicon.png">
  
  
    <link href="//fonts.googleapis.com/css?family=Source+Code+Pro" rel="stylesheet" type="text/css">
  
  <link rel="stylesheet" href="/css/style.css">
  

</head>

<body>
  <div id="container">
    <div id="wrap">
      <header id="header">
  <div id="banner"></div>
  <div id="header-outer" class="outer">
    <div id="header-title" class="inner">
      <h1 id="logo-wrap">
        <a href="/" id="logo">Matrix207&#39;s Blog</a>
      </h1>
      
    </div>
    <div id="header-inner" class="inner">
      <nav id="main-nav">
        <a id="main-nav-toggle" class="nav-icon"></a>
        
          <a class="main-nav-link" href="/">Home</a>
        
          <a class="main-nav-link" href="/archives">Archives</a>
        
      </nav>
      <nav id="sub-nav">
        
          <a id="nav-rss-link" class="nav-icon" href="/atom.xml" title="Flux RSS"></a>
        
        <a id="nav-search-btn" class="nav-icon" title="Rechercher"></a>
      </nav>
      <div id="search-form-wrap">
        <form action="//google.com/search" method="get" accept-charset="UTF-8" class="search-form"><input type="search" name="q" results="0" class="search-form-input" placeholder="Search"><button type="submit" class="search-form-submit">&#xF002;</button><input type="hidden" name="sitesearch" value="http://yoursite.com"></form>
      </div>
    </div>
  </div>
</header>
      <div class="outer">
        <section id="main"><article id="post-linux-io-performance-monitor" class="article article-type-post" itemscope itemprop="blogPost">
  <div class="article-meta">
    <a href="/2014/07/30/linux-io-performance-monitor/" class="article-date">
  <time datetime="2014-07-29T16:00:00.000Z" itemprop="datePublished">2014-07-30</time>
</a>
    
  <div class="article-category">
    <a class="article-category-link" href="/categories/storage/">storage</a>
  </div>

  </div>
  <div class="article-inner">
    
    
      <header class="article-header">
        
  
    <h1 class="article-title" itemprop="name">
      Linux IO performance monitor
    </h1>
  

      </header>
    
    <div class="article-entry" itemprop="articleBody">
      
        <h3 id="What-your-should-know"><a href="#What-your-should-know" class="headerlink" title="What your should know"></a>What your should know</h3><ul>
<li><p>Your system parameters:</p>
<ul>
<li>storage device: HDD, SSD (which?), Raid (which?)</li>
<li>filesystem, block size, journal mode</li>
<li>file cache, dirty thresholds, amount of memory</li>
<li>IO scheduler, its tunables</li>
<li>number of CPUs</li>
<li>kernel version</li>
</ul>
</li>
<li><p>Your test parameters:</p>
<ul>
<li>read or write performance?</li>
<li>sequential or random?</li>
<li>1 thread or multiple?</li>
<li>size of requests</li>
<li>optimize for throughput or request delay?</li>
</ul>
</li>
<li><p>IO’s Per Second（IOPS） </p>
<ul>
<li>IOPS=1000/(tseek+trotation+transfer), tseek:3~15ms, trotation:2ms, Transfer&lt;&lt;1<br>IOPS=1000/(5+2)=142</li>
</ul>
</li>
<li><p>random io and sequential io</p>
</li>
</ul>
<h3 id="Monitor"><a href="#Monitor" class="headerlink" title="Monitor"></a>Monitor</h3><ul>
<li><p>start from dd test (install centos 7 to u-disk)</p>
<p>  [root@localhost Downloads]# dd if=/home/dennis/Downloads/CentOS-7.0-1406-x86_64-DVD.iso of=/dev/sdc</p>
</li>
<li><p>using /proc/diskstats</p>
<pre><code>[dennis@localhost Downloads]$ cat /proc/diskstats
   8   0 sda 141736 59689 8916560 2493999 102005 133358 13766420 6019722 1 954049 8513774
   8   1 sda1 286 562 3822 5720 7 1 28 156 0 4959 5875
   8   2 sda2 141324 59017 8910850 2482584 90409 133357 13766392 5797210 1 762103 8279724
 253   0 dm-0 14247 0 113976 102438 61899 0 495192 6397303 0 45071 6499746
 253   1 dm-1 151287 0 5630082 3598603 47156 0 1021320 5247386 0 551034 8846229
 253   2 dm-2 35848 0 3166248 352901 115404 0 12249880 2422762 1 524204 2775689
   8  16 sdb 152 871 2311 604 0 0 0 0 0 564 604
   8  17 sdb1 70 801 1095 280 0 0 0 0 0 262 280
   8  32 sdc 248265 108 1986984 316895 5710 170143 1370400 48417446 158 346876 49258416
   8  33 sdc1 248249 108 1986856 316866 5710 170143 1370400 48417446 158 346847 49258387
</code></pre></li>
</ul>
<pre><code>- [dennis@localhost Downloads]$ cat /proc/diskstats | grep &quot;sdc &quot;
  下面的显示去掉了 &quot;8   32 sd &quot;
  +   1     2    3        4    5     6        7      8       9     10      11
  + 132725 108 1062664 167643 2681  81983  643440  24022041  147 177399  24801880
  + 274044 108 2193216 348847 6582  195199 1579680 54459810  150 388700  55296467
  + 480307 108 3843320 608357 13408 392863 3217920 101917275 139 719423  103013695
  + 636845 108 5095624 802159 18568 542271 4456320 138060107 132 971278  139338459 
  + 717802 108 5743280 902925 21254 620223 5100960 156763894 134 1101859 158182895 
- 第1个域：读完成次数 ----- 读磁盘的次数，成功完成读的总次数。
- 第2个域：合并读完成次数， 第6个域：合并写完成次数。为了效率可能会合并相邻
           的读和写。从而两次4K的读在它最终被处理到磁盘上之前可能会变成一次
           8K的读，才被计数（和排队），因此只有一次I/O操作。这个域使你知
  道这样的操作有多频繁。
- 第3个域：读扇区的次数，成功读过的扇区总次数。
- 第4个域：读花费的毫秒数，这是所有读操作所花费的毫秒数
           (用make_request()到end_that_request_last()测量)
- 第5个域：写完成次数 ----写完成的次数，成功写完成的总次数。
- 第6个域：合并写完成次数 -----合并写次数。
- 第7个域：写扇区次数 ---- 写扇区的次数，成功写扇区总次数。
- 第8个域：写操作花费的毫秒数  ---  写花费的毫秒数，这是所有写操作所花费的毫秒数
- 第9个域：正在处理的输入/输出请求数 -- -I/O的当前进度，只有这个域应该是0。
           当请求被交给适当的request_queue_t时增加和请求完成时减小。
- 第10个域：输入/输出操作花费的毫秒数  ----花在I/O操作上的毫秒数，这个域会增长只要field 9不为0。
- 第11个域：输入/输出操作花费的加权毫秒数 -----  加权，花在I/O操作上的毫秒数，
            在每次I/O开始，I/O结束，I/O合并时这个域都会增加。这可以给I/O完成
            时间和存储那些可以累积的提供一个便利的测量标准。
</code></pre><ul>
<li><p>using vmstat</p>
<pre><code>[dennis@localhost Downloads]$ vmstat 1 10
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so   bi    bo   in   cs us sy id wa
 0  2 262060  79832 1290864 736688  0    2    82    80  165  143  5  1 92  2
 0  2 262060  81964 1279336 746696  0    0  5176  3840 5693 10504  5 10 23 62
 0  2 262060  75888 1282288 749680  0    0  5896  3840 5259 11483  5  5 41 49
 0  2 262060  70184 1285204 752636  0    0  5860     0 5213 11354  6  2 39 53
 1  2 262060  79092 1281472 747172  0    0  5668  3904 5047 11017  5  4 43 49
 1  2 262060  79584 1284256 743532  0    0  5832     0 5004 11202  5  2 43 50
 0  2 262060  77532 1287020 742796  0    0  5672  3840 5126 11111  6  3 39 53
 0  2 262060  79668 1289484 738468  0    0  5316     0 5598 10422  5  5 23 68
 0  2 262060  79536 1290632 737000  0    0  5180  3840 4860 10482  6  3 41 50
 0  2 262060  79880 1291936 735188  0    0  5160     0 5469 10400  5  6 27 62

[dennis@localhost Downloads]$ vmstat -d
disk- ------------reads------------ ------------writes----------- -----IO------
       total merged sectors      ms  total merged sectors      ms   cur   sec
sda   188079  70330 16034138 2811643 108057 169484 14406740 8013520   0  1118
dm-0   15970      0  127760  112213  93653      0  749224  16348510   0    70
dm-1  181140      0 6578234 4012264  51721      0 1236960   7818610   0   681
dm-2   61516      0 9321616  477028 121227      0 12420520  2505467   0   622
sdb      152    871    2311     604      0      0       0         0   0     0
sdc   1012855   108 8103704 1284706  33810 978925 8101888 241555468   0  1636
</code></pre></li>
<li><p>using top(using <code>man top</code> for help)   </p>
</li>
<li><p>using iostat(using <code>man iostat</code> for help)   </p>
<pre><code>[dennis@localhost Downloads]$ su -c &apos;yum install sysstat -y&apos;
[dennis@localhost Downloads]$ iostat -x 1 3
Linux 3.15.6-200.fc20.x86_64 (localhost.localdomain)     07/30/2014     _x86_64_    (2 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           4.59    0.15    1.48    2.20    0.00   91.59

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.46     1.11    1.25    0.72    53.26    48.59   103.44     0.07   36.97   15.02   75.16   3.76   0.74
dm-0              0.00     0.00    0.10    0.61     0.42     2.43     8.00     0.11  156.53    7.06  182.19   0.65   0.05
dm-1              0.00     0.00    1.21    0.34    21.67     4.18    33.36     0.08   51.41   22.36  152.90   2.90   0.45
dm-2              0.00     0.00    0.41    0.80    31.16    41.98   120.98     0.02   16.56    7.58   21.12   3.43   0.41
sdb               0.01     0.00    0.00    0.00     0.01     0.00    15.20     0.00    3.97    3.97    0.00   3.71   0.00
sdc               0.00     6.08    6.77    0.21    27.07    25.02    14.94     1.52  217.29    1.27 7226.26   1.52   1.06

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           2.91    0.00    9.22   52.91    0.00   34.95

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00   660.00   22.00    8.00  2816.00  3404.00   414.67     0.08    2.83    0.50    9.25   1.63   4.90
dm-0              0.00     0.00    0.00  666.00     0.00  2664.00     8.00     7.13   10.84    0.00   10.84   0.06   3.80
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00   22.00    0.00  2816.00     0.00   256.00     0.01    0.50    0.50    0.00   0.50   1.10
sdb               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
sdc               0.00     0.00  719.00   15.00  2876.00  1800.00    12.74   150.38  197.33    1.32 9592.53   1.36 100.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           3.06    0.00    3.57   51.02    0.00   42.35

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     0.00   23.00    1.00  2944.00     4.00   245.67     0.01    0.50    0.52    0.00   0.50   1.20
dm-0              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    1.00     0.00     4.00     8.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00   23.00    0.00  2944.00     0.00   256.00     0.01    0.52    0.52    0.00   0.52   1.20
sdb               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
sdc               0.00   928.00  733.00   15.00  2932.00  1800.00    12.65   136.75  211.08    1.36 10459.40   1.34 100.00
[dennis@localhost Downloads]$ watch iostat -x 
</code></pre></li>
<li><p>using shell script monitor_io_stats.sh</p>
<pre><code>#!/bin/sh
/etc/init.d/syslog stop
echo 1 &gt; /proc/sys/vm/block_dump
sleep 60
dmesg | awk &apos;/(READ|WRITE|dirtied)/ {process[$1]++} END {for (x in process) \
print process[x],x}&apos; |sort -nr |awk &apos;{print $2 &quot; &quot; $1}&apos; | \
head -n 10
echo 0 &gt; /proc/sys/vm/block_dump
/etc/init.d/syslog start
</code></pre></li>
</ul>
<h3 id="Other-tools"><a href="#Other-tools" class="headerlink" title="Other tools"></a>Other tools</h3><ul>
<li><p>IOMeter, using for testing block device</p>
<ul>
<li>Test parameters<ul>
<li>of Outstanding I/Os, using <code>8</code> per target</li>
<li>each worker select one target?</li>
<li>100% Write or 100% Read</li>
<li>Sequential or Random</li>
<li>Transfer Request Size using 1MB</li>
<li>Result Since, select <code>Last Update</code></li>
<li>Update Frequency(seconds) select <code>1</code></li>
</ul>
</li>
</ul>
</li>
<li><p>SANergy, using for testing filesystem(Samba)</p>
<ul>
<li>Select <code>Performance Tester</code></li>
<li>Select driver(mapping the director as a driver, such as Z)</li>
<li>Select <code>Read test</code> or <code>Write test</code></li>
<li>File size(MB) using <code>10240</code></li>
<li>Record size(KB) using <code>1024</code></li>
<li>select ‘Loop’</li>
<li>start test</li>
</ul>
</li>
<li><p>Iozone: a filesystem benchmark tool</p>
<ul>
<li>download from <a href="http://www.iozone.org/src/current/" target="_blank" rel="external">http://www.iozone.org/src/current/</a></li>
<li>compile source code: <code>make linux-AMD64</code>(NOTICE: check you cpu model and select correct command for compile)</li>
<li>test for nfs<ul>
<li>showmount -e 172.16.130.111</li>
<li>mkdir /mnt/nastest</li>
<li>mount -t nfs 172.16.130.111:/share/nfs1 /mnt/nastest</li>
<li>./iozone -az -b /mnt/nastest/test.xls -g 256G -y 32k -i 0 -i 1   </li>
</ul>
</li>
</ul>
</li>
<li><p>FIO  </p>
<ul>
<li>read: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=read --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest</code></li>
<li>write: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=write --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest</code></li>
<li>random read: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=randread --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest</code></li>
<li>random write: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=randwrite --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest</code></li>
<li>Mix random read and write: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=randrw --rwmixread=70 --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest --ioscheduler=noop</code></li>
</ul>
</li>
<li><p>blktrace: is a block layer IO tracing mechanism which provides detailed information  </p>
<pre><code>about request queue operations up to user space.
</code></pre><ul>
<li>read: <code>fio --filename=/dev/sda3 --direct=1 --iodepth 1 --thread --rw=read --ioengine=psync --bs=4k --size=2G --numjobs=10 --runtime=100 --group_reporting --name=mytest</code></li>
</ul>
</li>
</ul>
<h3 id="Example"><a href="#Example" class="headerlink" title="Example"></a>Example</h3><ul>
<li><p>Troubleshooting high <code>uitl</code> of <code>iostat</code> command</p>
<ul>
<li>using <code>iostat -x 2 5</code> to view the disk information</li>
</ul>
</li>
<li><p>Troubleshooting high <code>uitl</code> of <code>iostat</code> command</p>
</li>
</ul>
<h3 id="Reference"><a href="#Reference" class="headerlink" title="Reference"></a>Reference</h3><ul>
<li><a href="http://os.51cto.com/art/201012/239886.htm" target="_blank" rel="external">Linux性能监测：磁盘IO篇</a></li>
<li><a href="http://www.tecmint.com/linux-performance-monitoring-with-vmstat-and-iostat-commands/" target="_blank" rel="external">Linux Performance Monitoring with Vmstat and Iostat Commands</a></li>
<li><a href="http://www.cnblogs.com/mfryf/archive/2012/03/12/2392012.html" target="_blank" rel="external">查看linux服务器硬盘IO读写负载</a></li>
<li><a href="http://blog.csdn.net/tenfyguo/article/details/7477526" target="_blank" rel="external">/proc/diskstats</a></li>
<li><a href="http://stackoverflow.com/a/3549620" target="_blank" rel="external">Testing IO performance in Linux</a></li>
<li><a href="http://www.jb51.net/LINUXjishu/65741.html" target="_blank" rel="external">linux 查看磁盘IO状态操作指南</a></li>
<li><a href="http://bannaych.blogspot.jp/2005/12/random-and-sequential-io.html" target="_blank" rel="external">random and sequential io</a></li>
<li><a href="http://en.wikipedia.org/wiki/Hard_disk_drive#Seek_time" target="_blank" rel="external">hdd seek time</a></li>
<li><a href="https://www.usenix.org/legacy/events/fast04/tech/full_papers/radkov/radkov_html/node14.html" target="_blank" rel="external">impact of sequential and random io</a></li>
<li><a href="http://wushank.blog.51cto.com/3489095/1585927" target="_blank" rel="external">linux下的CPU、内存、IO、网络的压力测试</a></li>
<li><a href="http://blog.csdn.net/liuaigui/article/details/6168186" target="_blank" rel="external">磁盘IOPS计算与测量</a></li>
<li><a href="http://dadaru.blog.51cto.com/218979/481394" target="_blank" rel="external">http://dadaru.blog.51cto.com/218979/481394</a></li>
<li><a href="http://dadaru.blog.51cto.com/218979/481394" target="_blank" rel="external">系统性能分析工具&amp;&amp;一些我对磁盘IOPS的简单认识</a></li>
<li><a href="http://www.dbabeta.com/2009/io-performence-01_several-concepts.html" target="_blank" rel="external">IO系统性能之一：衡量性能的几个指标</a></li>
<li><a href="http://blog.yufeng.info/archives/tag/fio" target="_blank" rel="external">fio性能测试工具新添图形前端gfio</a></li>
<li><a href="http://blog.itpub.net/26855487/viewspace-754346/" target="_blank" rel="external">linux 使用FIO测试磁盘iops</a></li>
<li>★★★<a href="http://bencane.com/2012/08/06/troubleshooting-high-io-wait-in-linux/" target="_blank" rel="external">Troubleshooting High I/O Wait in Linux</a></li>
<li>★★★<a href="http://blogread.cn/it/article/6145" target="_blank" rel="external">通过blktrace, debugfs分析磁盘IO</a></li>
</ul>

      
    </div>
    <footer class="article-footer">
      <a data-url="http://yoursite.com/2014/07/30/linux-io-performance-monitor/" data-id="ciqqpe1qi00a9nmpv27wchjc7" class="article-share-link">Partager</a>
      
      
  <ul class="article-tag-list"><li class="article-tag-list-item"><a class="article-tag-list-link" href="/tags/performance/">performance</a></li></ul>

    </footer>
  </div>
  
    
<nav id="article-nav">
  
    <a href="/2014/07/30/linux-memory-performance-monitor/" id="article-nav-newer" class="article-nav-link-wrap">
      <strong class="article-nav-caption">Récent</strong>
      <div class="article-nav-title">
        
          Linux Memory performance monitor
        
      </div>
    </a>
  
  
    <a href="/2014/07/28/data-structures-relation-to-image/" id="article-nav-older" class="article-nav-link-wrap">
      <strong class="article-nav-caption">Ancien</strong>
      <div class="article-nav-title">data structures relation to image</div>
    </a>
  
</nav>

  
</article>

</section>
        
          <aside id="sidebar">
  
    
  <div class="widget-wrap">
    <h3 class="widget-title">Catégories</h3>
    <div class="widget">
      <ul class="category-list"><li class="category-list-item"><a class="category-list-link" href="/categories/blog/">blog</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/database/">database</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/english/">english</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/kernel/">kernel</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/language/">language</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/linux/">linux</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/math/">math</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/network/">network</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/others/">others</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/person/">person</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/program/">program</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/source/">source</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/storage/">storage</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/tools/">tools</a></li><li class="category-list-item"><a class="category-list-link" href="/categories/windows/">windows</a></li></ul>
    </div>
  </div>


  
    
  <div class="widget-wrap">
    <h3 class="widget-title">Mot-clés</h3>
    <div class="widget">
      <ul class="tag-list"><li class="tag-list-item"><a class="tag-list-link" href="/tags/FAQ/">FAQ</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/IRC/">IRC</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/Translation/">Translation</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/android/">android</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/api/">api</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/assembly/">assembly</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/awk/">awk</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/batch/">batch</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/blog/">blog</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/book/">book</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/c/">c</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/c/">c++</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/cache/">cache</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/crash/">crash</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/database/">database</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/debug/">debug</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/dot/">dot</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/driver/">driver</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/emacs/">emacs</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/exploit/">exploit</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/file-system/">file system</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/filesystem/">filesystem</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/flowchart/">flowchart</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/gcc/">gcc</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/git/">git</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/google/">google</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/graphviz/">graphviz</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/hexo/">hexo</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/hosts/">hosts</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/iscsi/">iscsi</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/java/">java</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/javascript/">javascript</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/job/">job</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/json/">json</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/kernel/">kernel</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/linux/">linux</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/lisp/">lisp</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/lua/">lua</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/makefile/">makefile</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/malloc/">malloc</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/math/">math</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/maxima/">maxima</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/memory/">memory</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/memory-overflow/">memory overflow</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/mtrace/">mtrace</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/netdisk/">netdisk</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/network/">network</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/others/">others</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/pandoc/">pandoc</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/performance/">performance</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/person/">person</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/protobuf/">protobuf</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/python/">python</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/rsync/">rsync</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/sed/">sed</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/shell/">shell</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/skype/">skype</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/sms/">sms</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/source/">source</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/ssh/">ssh</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/stack/">stack</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/storage/">storage</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/study/">study</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/svn/">svn</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/sync/">sync</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/test/">test</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/time/">time</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/tools/">tools</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/valgrind/">valgrind</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/vi/">vi</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/vim/">vim</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/virtual/">virtual</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/wget/">wget</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/windows/">windows</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/wireshark/">wireshark</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/write/">write</a></li><li class="tag-list-item"><a class="tag-list-link" href="/tags/xml/">xml</a></li></ul>
    </div>
  </div>


  
    
  <div class="widget-wrap">
    <h3 class="widget-title">Nuage de mot-clés</h3>
    <div class="widget tagcloud">
      <a href="/tags/FAQ/" style="font-size: 10px;">FAQ</a> <a href="/tags/IRC/" style="font-size: 10px;">IRC</a> <a href="/tags/Translation/" style="font-size: 13px;">Translation</a> <a href="/tags/android/" style="font-size: 10px;">android</a> <a href="/tags/api/" style="font-size: 10px;">api</a> <a href="/tags/assembly/" style="font-size: 10px;">assembly</a> <a href="/tags/awk/" style="font-size: 11px;">awk</a> <a href="/tags/batch/" style="font-size: 14px;">batch</a> <a href="/tags/blog/" style="font-size: 10px;">blog</a> <a href="/tags/book/" style="font-size: 10px;">book</a> <a href="/tags/c/" style="font-size: 16px;">c</a> <a href="/tags/c/" style="font-size: 19px;">c++</a> <a href="/tags/cache/" style="font-size: 10px;">cache</a> <a href="/tags/crash/" style="font-size: 10px;">crash</a> <a href="/tags/database/" style="font-size: 17px;">database</a> <a href="/tags/debug/" style="font-size: 12px;">debug</a> <a href="/tags/dot/" style="font-size: 10px;">dot</a> <a href="/tags/driver/" style="font-size: 10px;">driver</a> <a href="/tags/emacs/" style="font-size: 11px;">emacs</a> <a href="/tags/exploit/" style="font-size: 10px;">exploit</a> <a href="/tags/file-system/" style="font-size: 10px;">file system</a> <a href="/tags/filesystem/" style="font-size: 12px;">filesystem</a> <a href="/tags/flowchart/" style="font-size: 10px;">flowchart</a> <a href="/tags/gcc/" style="font-size: 10px;">gcc</a> <a href="/tags/git/" style="font-size: 12px;">git</a> <a href="/tags/google/" style="font-size: 11px;">google</a> <a href="/tags/graphviz/" style="font-size: 11px;">graphviz</a> <a href="/tags/hexo/" style="font-size: 10px;">hexo</a> <a href="/tags/hosts/" style="font-size: 10px;">hosts</a> <a href="/tags/iscsi/" style="font-size: 14px;">iscsi</a> <a href="/tags/java/" style="font-size: 10px;">java</a> <a href="/tags/javascript/" style="font-size: 10px;">javascript</a> <a href="/tags/job/" style="font-size: 10px;">job</a> <a href="/tags/json/" style="font-size: 10px;">json</a> <a href="/tags/kernel/" style="font-size: 14px;">kernel</a> <a href="/tags/linux/" style="font-size: 14px;">linux</a> <a href="/tags/lisp/" style="font-size: 10px;">lisp</a> <a href="/tags/lua/" style="font-size: 10px;">lua</a> <a href="/tags/makefile/" style="font-size: 10px;">makefile</a> <a href="/tags/malloc/" style="font-size: 10px;">malloc</a> <a href="/tags/math/" style="font-size: 11px;">math</a> <a href="/tags/maxima/" style="font-size: 10px;">maxima</a> <a href="/tags/memory/" style="font-size: 11px;">memory</a> <a href="/tags/memory-overflow/" style="font-size: 10px;">memory overflow</a> <a href="/tags/mtrace/" style="font-size: 10px;">mtrace</a> <a href="/tags/netdisk/" style="font-size: 10px;">netdisk</a> <a href="/tags/network/" style="font-size: 20px;">network</a> <a href="/tags/others/" style="font-size: 18px;">others</a> <a href="/tags/pandoc/" style="font-size: 10px;">pandoc</a> <a href="/tags/performance/" style="font-size: 16px;">performance</a> <a href="/tags/person/" style="font-size: 11px;">person</a> <a href="/tags/protobuf/" style="font-size: 11px;">protobuf</a> <a href="/tags/python/" style="font-size: 10px;">python</a> <a href="/tags/rsync/" style="font-size: 10px;">rsync</a> <a href="/tags/sed/" style="font-size: 11px;">sed</a> <a href="/tags/shell/" style="font-size: 15px;">shell</a> <a href="/tags/skype/" style="font-size: 11px;">skype</a> <a href="/tags/sms/" style="font-size: 10px;">sms</a> <a href="/tags/source/" style="font-size: 11px;">source</a> <a href="/tags/ssh/" style="font-size: 10px;">ssh</a> <a href="/tags/stack/" style="font-size: 10px;">stack</a> <a href="/tags/storage/" style="font-size: 15px;">storage</a> <a href="/tags/study/" style="font-size: 10px;">study</a> <a href="/tags/svn/" style="font-size: 11px;">svn</a> <a href="/tags/sync/" style="font-size: 10px;">sync</a> <a href="/tags/test/" style="font-size: 11px;">test</a> <a href="/tags/time/" style="font-size: 10px;">time</a> <a href="/tags/tools/" style="font-size: 16px;">tools</a> <a href="/tags/valgrind/" style="font-size: 10px;">valgrind</a> <a href="/tags/vi/" style="font-size: 10px;">vi</a> <a href="/tags/vim/" style="font-size: 14px;">vim</a> <a href="/tags/virtual/" style="font-size: 11px;">virtual</a> <a href="/tags/wget/" style="font-size: 10px;">wget</a> <a href="/tags/windows/" style="font-size: 11px;">windows</a> <a href="/tags/wireshark/" style="font-size: 10px;">wireshark</a> <a href="/tags/write/" style="font-size: 13px;">write</a> <a href="/tags/xml/" style="font-size: 10px;">xml</a>
    </div>
  </div>

  
    
  <div class="widget-wrap">
    <h3 class="widget-title">Archives</h3>
    <div class="widget">
      <ul class="archive-list"><li class="archive-list-item"><a class="archive-list-link" href="/archives/2016/07/">July 2016</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2016/04/">April 2016</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2016/03/">March 2016</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2016/02/">February 2016</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2016/01/">January 2016</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/11/">November 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/10/">October 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/09/">September 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/08/">August 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/07/">July 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/06/">June 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/03/">March 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/02/">February 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2015/01/">January 2015</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/12/">December 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/11/">November 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/09/">September 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/08/">August 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/07/">July 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/06/">June 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/05/">May 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/04/">April 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2014/03/">March 2014</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/11/">November 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/10/">October 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/09/">September 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/08/">August 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/07/">July 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/06/">June 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/05/">May 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/04/">April 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/03/">March 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/02/">February 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2013/01/">January 2013</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2012/12/">December 2012</a></li><li class="archive-list-item"><a class="archive-list-link" href="/archives/2012/09/">September 2012</a></li></ul>
    </div>
  </div>


  
    
  <div class="widget-wrap">
    <h3 class="widget-title">Articles récents</h3>
    <div class="widget">
      <ul>
        
          <li>
            <a href="/2016/07/17/how-to-implement-malloc/">如何实现一个malloc</a>
          </li>
        
          <li>
            <a href="/2016/07/17/study-grep-more/">grep工作原理</a>
          </li>
        
          <li>
            <a href="/2016/07/17/2016-04-13-malloc/">malloc</a>
          </li>
        
          <li>
            <a href="/2016/04/27/include-what-you-use/">使用IWYU整理头文件引用</a>
          </li>
        
          <li>
            <a href="/2016/04/24/understand-gcc-assembly-output/">understand gcc assembly output</a>
          </li>
        
      </ul>
    </div>
  </div>

  
</aside>
        
      </div>
      <footer id="footer">
  
  <div class="outer">
    <div id="footer-info" class="inner">
      &copy; 2016 Matrix207<br>
      Propulsé by <a href="http://hexo.io/" target="_blank">Hexo</a>
    </div>
  </div>
</footer>
    </div>
    <nav id="mobile-nav">
  
    <a href="/" class="mobile-nav-link">Home</a>
  
    <a href="/archives" class="mobile-nav-link">Archives</a>
  
</nav>
    

<script src="//ajax.googleapis.com/ajax/libs/jquery/2.0.3/jquery.min.js"></script>


  <link rel="stylesheet" href="/fancybox/jquery.fancybox.css">
  <script src="/fancybox/jquery.fancybox.pack.js"></script>


<script src="/js/script.js"></script>

  </div>
</body>
</html>